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(57) Abstract 

A method of encoding images (1) including areas (1 1) of relevant pixels and areas (12) of irrelevant pixels (e.g. a background) is 
disclosed. The pixels of the irrelevant area are replaced (4) by pseudo-pixels smoothing the transition between said areas. The image thus 
obtained is subsequently subjected to conventional image coding (5) which now yields considerably fewer bits. At the receiver end, the 
pseudo-pixels are replaced (9) by predetermined background pixels to reconstruct the original boundaries (13). If the boundary between 
both areas is not known in advance, the boundary is detected (2), encoded (3) and transmitted to the receiver. The invention is particularly 
applicable to compression of medical images having circular areas of interest, but may also be used to encode other video images having 
irrelevant areas such as videophone images in which a head-and-shoulder area constitutes relevant information only. 
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Method and arrangement for encoding and decoding images 



FIELD OF THE INVENTION 

The invention relates to a method of encoding images including areas of 
relevant image data and areas of irrelevant image data, comprising the step of identifying 
said irrelevant image data. The invention also relates to a method of decoding encoded 
5 images and corresponding arrangements for encoding and decoding — 

BACKGROUND OF THE INVENTION 

Video images usually have a rectangular shape, but the user is not always 
interested in the whole rectangular image area. For example, medical images often comprise 

10 medically relevant information in a circular area. The images thus exhibit a sharp transition 
between this circular area and an irrelevant (usually black) background. German Patent 
DE 36 13 759 discloses a method of recording such images. Data compression is herein 
achieved by omitting the pixels of the irrelevant image areas. The boundary between the 
relevant image area and the irrelevant image area is known in advance to both the transmitter 

15 and the receiver. The receiver thus knows for each received pixel its display position on the 
screen. 

Currently, video images are often encoded and compressed by encoding 
methods such as block transform coding or DPCM which exploit the correlation between 
contiguous pixels within an image. In such encoding methods, sharp transitions between 
20 contiguous pixels require a large number of bits. The boundaries between relevant and 
irrelevant areas in the above-mentioned types of images thus affect the coding efficiency 
considerably. 

OBJECT AND SUMMARY OF THE INVENTION 
25 It is an object of the invention to provide a method of encoding images by 

"which the coding efficiency is improved. 

The method according the invention is characterized by replacing at least 
irrelevant image data next to a boundary between said areas by pseudo-image data smoothing 
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^^Jte^lxw^n between relevapt and irrelevant image data. Experiments have shown that 

medical images can now be encoded at a 30% lower bit rate. 

The corresponding method of decoding images is characterized by 

identifying pseudo-image data in response to boundary information and replacing said 
5 pseudo-image data by predetermined image data. The sharp boundaries between areas of 

relevant image data and areas of predetermined image data are thus reconstructed. The 

reconstructed image has the same appearance as the original image which a medical specialist 

is used to seeing. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig.l shows a diagram of a system adapted to encode and decode video 
images according to the invention. 

Figs.2A-2E show signal waveforms illustrating the operation of 
embodiments of a modifying circuit shown in Fig. 1. 
15 Figs. 3A-3C show image areas further illustrating the operation of a 

particular embodiment of the modifying circuit shown in Fig.l. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig.l shows a diagram of a system for encoding and decoding video 

20 images according to the invention. Reference numeral 1 denotes a rectangular image to be 
encoded. As has been attempted to show in Fig.l, the image comprises a circular image area 
11 of relevant pixels and an image area 12 of irrelevant pixels. The boundary between both 
areas is denoted by the reference numeral 13. Hereinafter, relevant pixels will be denoted by 
x[i,j] and irrelevant pixels will be denoted by y[i,j]. Pseudo-pixels will be denoted by p[ij]. 

25 The image is applied to a boundary detection circuit 2 which is adapted to 

detect boundary 13, e.g. detect abrupt transients from (black) pixels having a background 
value to relevant pixels and vice versa. A practical embodiment of boundary circuit 2 is 
disclosed in US patent 5,014,198. Boundary 13 is losslessly encoded by a boundary encoding 
stage 3 and transmitted or recorded. Lossless encoding methods are known in the art. For 

30 example, run-length coding can be applied to a mask defining the area of irrelevant pixels. If 
The area of relevant pixels is circular, only the centre and radius of a circle need to be 
transmitted. Boundary detection circuit 2 and encoding stage 3 can be omitted if the 
boundaries are known in advance. 
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Image 1 is further applied to a modifying circuit 4. This circuit receives 
boundary information from boundary detection circuit 2 and determines, in response thereto, 
whether applied pixels are relevant pixels from area 11 or irrelevant pixels from area 12. 
Irrelevant pixels are modified, as will be described hereinafter. The pixels are subsequently 

5 applied to a conventional image encoder 5, for example a block-based transform encoder or a 
DPCM encoder. The encoded boundary information B and image information I are stored on 
a storage medium for later retrieval, or transmitted to a remote receiver. The storage or 
transmission medium is denoted by reference numeral 6. 

Embodiments of modifying circuit 4 will now be described in terms of 

10 their respective output signals. Practical circuits can easily be designed by those skilled in the - 
art of digital signal processing. Figs.2A-2E show waveforms of the respective signals. For 
convenience, one-dimensional signals are shown, but it will be appreciated that the modifying 
operation is preferably applied in the two-dimensional image space. Fig.2A shows the input 
signal for reference. It comprises a series of irrelevant pixels y[n] and a series of relevant 

15 pixels x[n]. The background of the image is here assumed to be black, hence all pixels y[n] 
have the value of zero. Figs.2B-2E show suitable output signals of the modifying circuit. The 
respective signals now comprise a series of pseudo-pixels p[n] and the series of relevant 
pixels x[n]. 

The waveform shown in Fig.2B is obtained by replacing the irrelevant 
20 pixels y[n] by identical pseudo-pixels p[n], the value of which corresponds to the first 
relevant pixel x[n] beyond the boundary. In the waveform shown in Fig.2C, the pseudo- 
pixels p[n] are chosen to gradually vary from their original value zero to the value of the 
first relevant pixel beyond the boundary. In the waveform of Fig.2D, the relevant image 
signal portion is mirrored into the irrelevant area. In addition, the pseudo-signal portion can 
25 optionally be low-pass filtered to further smooth the transition, so that significant AC 

coefficients are prevented from occurring and the coding efficiency is further improved. The 
waveform of Fig.2E shows pseudo-pixels p[n] obtained by extrapolating the pixels x[n] of 
the relevant area into the irrelevant area. 

The extrapolation as shown in Fig.2E will now be described for the two- 
30 dimensional image space. In Figs. 3A-3C, the top-left corner of a rectangular image is 
Hshown. In Fig.3A, a pixel block 41 having an adequate size (here a 4*4 block is shown) is 
initially chosen to be such that the block includes a single irrelevant pixel 51 in the top left 
corner. The irrelevant pixel y[i,j] is then replaced by a pseudo-pixel p[i,j] having the average 
value of all other pixels in the block. In a mathematical notation, this is: 
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PUJ] = — ~7 £ 
iv -1 *mh»o,o 

in which n and m (n,m=O..N) denote pixel locations in the N*N block. The above operation 
is repeated for all irrelevant pixels y[i,j] along the boundary between relevant area 11 and 
irrelevant area 12 until the last irrelevant pixel 55 has been processed. Block 41 thus moves 
5 along the boundary as indicated by arrow 42. While the block proceeds, it may include 
pseudo-pixels generated beforehand, as well as irrelevant pixels not yet replaced. When pixel 
52 is being extrapolated, the block also includes pseudo-pixel 51. When pixel 53 is being 
processed, the block also includes irrelevant pixel 54. Pseudo-pixels are incorporated in the 
averaging step, irrelevant pixels are not. 

10 Fig.3B shows the situation after all boundary pixels y[i,j] have been 

replaced by pseudo-pixels p[i,j] (shown shaded). The block then moves in a reverse direction 
along the new boundary thus created. FigJC shows the situation at a further stage of the 
process. Irrelevant pixel 56 is now being replaced by the average of pixels in block 41 and 
the block is now moving along the boundary as indicated by arrow 43. As the extrapolation 

15 process proceeds, more pseudo-pixels will be included in block 41. Eventually, the vertex 57 
of the rectangular image is reached. By then, all pseudo-pixels will have obtained nearly the 
same value. Image area 12 can thus be encoded very efficiently. The extrapolated image area 
can be further smoothed by using a 2-dimensional low-pass filter. This smoothing ensures 
that the extrapolated area does not contain a significant amount of energy. 

20 Reverting now to Fig.l, a method of decoding will be described. A 

conventional decoder 7 (e.g. a block-based transform decoder or DPCM decoder) carries out 
the inverse operation of encoder 5 at the transmitter end. Decoder 7 thus reconstructs the 
pixels as transmitted by the encoder. If they are displayed on the screen in an unaltered 

form, the pseudo-pixels will cause an image to appear, which the viewer (here a medical 

25 specialist) is not familiar with. A boundary decoder 8 receives the codewords B representing 
the boundary between relevant and pseudo-data. Alternatively, the boundaries are known in 
advance, in which case they are locally stored. The decoded pixels and boundary information 
are applied to a reconstruction circuit 9. In response to the boundary information, the 
reconstruction circuit identifies which pixels are pseudo-pixels p[i,j] and which are relevant 

30 pixels x[i,j]. As will be appreciated in view of the foregoing description, the reconstruction 
circuit 9 does not affect pixels other than pseudo-pixels. The pseudo-image pixels are 
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replaced by predetermined image data, e.g. black pixels. The image thus reconstructed 
exhibits the same sharp boundaries as the original image. ^ 

The conventional video encoder 5 (Fig.l) may be a block transform 
encoder. In that case, the video image is divided into image blocks which are subjected to a 

5 given orthogonal transform such as the well-known Discrete Cosine Transform. Most blocks 
will comprise relevant pixels only, others will comprise irrelevant pixels only, and so-called 
"mixed blocks" will comprise both relevant and irrelevant image data. The above-described 
replacement of irrelevant pixels by pseudo-pixels now needs to be applied to mixed blocks 
only. The blocks comprising irrelevant pixels only do not need to be transformed at all. They 

10 can either be ignored, or encoded into a single DC coefficient (preferably zero,, e.g. black) 

In summary, a method of encoding images including areas of relevant 
pixels and areas of irrelevant pixels (e.g. a background) is disclosed. The pixels of the 
irrelevant area are replaced by pixels smoothing the transition between said areas. The image 
thus obtained is subsequently subjected to conventional image coding which now yields 

15 considerably fewer bits. At the receiver end, the pseudo-pixels are replaced by predetermined 
background pixels to reconstruct the original boundaries. If the boundary between both areas 
is not known in advance, the boundary is detected, encoded and transmitted to the receiver. 
The invention is particularly applicable to compression of medical images having circular 
areas of interest, but may also be used to encode other video images having irrelevant areas 

20 such as videophone images in which a head-and-shoulder area constitutes relevant 
information only. 
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Claims 



1. A method of encoding images including areas (1 1) of relevant image data 
and areas (12) of irrelevant image data, comprising the step of identifying (2) said irrelevant 
image data, characterized by replacing (4) at least irrelevant image data next to a boundary 
(13) between said areas by pseudo-image data smoothing the transition between relevant and 

5 irrelevant image data. 

2. A method as claimed in Claim 1, characterized by detecting (2) and 
encoding (3) the boundary between said areas. 

3. An encoder for encoding images including areas (11) of relevant image 
data and areas (12) of irrelevant image data, comprising means (2) for identifying said 
irrelevant image data, characterized by means (4) for replacing at least irrelevant image data 
next to a boundary (13) between said areas by pseudo-image data smoothing the transition 
between relevant and irrelevant image data. 

4. An encoder as claimed in Claim 3, characterized by means (2) for 
detecting and means (3) for encoding the boundary between said areas. 

5. A method of decoding images including areas (11) of relevant image data 
20 and areas (12) of irrelevant image data, characterized by identifying (8) pseudo-image data in 

response to boundary information and replacing (9) said pseudo-image data by predetermined 
image data. 

6. A method as claimed in Claim 5, characterized by receiving (8) encoded 
25 boundary information and decoding (8) said boundary information. 

7. ^ - - • A decoder for decoding images including areas (11) of relevant image 
data and areas (12) of irrelevant image data, characterized by means (8) for identifying 
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pseudo-image data in response to boundary information and means (9) for replacing said 
pseudo-image data by predetermined image data. 

8. A decoder as claimed in Claim 7, characterized by means (8) for 
5 receiving encoded boundary information and means (8) for decoding said boundary 

information. 

9. An encoded image signal representing an image including areas of 
relevant image data and areas of irrelevant image data, characterized in that the irrelevant 

10 image data has been replaced by pseudo-image data smoothing the transition between relevant 
and irrelevant image data. 

10. An image signal as claimed in Claim 9, further including boundary 
information (B) defining the boundary between said areas. 

15 

11. A digital storage medium (6) on which a signal as claimed in Claim 9 or 
10 is stored. 
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